Pandas Profiling Report

Dataset statistics

Number of variables	13
Number of observations	2969
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	301.7 KiB
Average record size in memory	104.0 B

Variable types

Numeric	12
Unsupported	1

Alerts

`gross_revenue` is highly correlated with `invoice_no` and 5 other fields	High correlation
`recency_days` is highly correlated with `invoice_no`	High correlation
`invoice_no` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`avg_quantity` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`total_quantity` is highly correlated with `gross_revenue` and 5 other fields	High correlation
`avg_ticket` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`avg_basket_size` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`avg_un_basket_size` is highly correlated with `avg_ticket`	High correlation
`qty_returns` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`avg_quantity` is highly skewed (γ1 = 51.34460134)	Skewed
`avg_ticket` is highly skewed (γ1 = 53.44422362)	Skewed
`qty_returns` is highly skewed (γ1 = 51.79774426)	Skewed
`avg_basket_size` is highly skewed (γ1 = 44.67271661)	Skewed
`df_index` has unique values	Unique
`customer_id` has unique values	Unique
`avg_recency_days` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`recency_days` has 34 (1.1%) zeros	Zeros
`qty_returns` has 1481 (49.9%) zeros	Zeros

Reproduction

Analysis started	2022-10-08 16:07:19.863685
Analysis finished	2022-10-08 16:07:51.557966
Duration	31.69 seconds
Software version	pandas-profiling v3.3.0
Download configuration	config.json

df_index
Real number (ℝ_≥0)

UNIQUE

Distinct	2969
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2317.292354

Minimum	0
Maximum	5715
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	0
5-th percentile	185.4
Q1	929
median	2120
Q3	3537
95-th percentile	5035.2
Maximum	5715
Range	5715
Interquartile range (IQR)	2608

Descriptive statistics

Standard deviation	1554.944589
Coefficient of variation (CV)	0.6710178739
Kurtosis	-1.010787014
Mean	2317.292354
Median Absolute Deviation (MAD)	1271
Skewness	0.342284058
Sum	6880041
Variance	2417852.674
Monotonicity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1	< 0.1%
3011	1	< 0.1%
2996	1	< 0.1%
2999	1	< 0.1%
3000	1	< 0.1%
3001	1	< 0.1%
3002	1	< 0.1%
3005	1	< 0.1%
3007	1	< 0.1%
3008	1	< 0.1%
Other values (2959)	2959	99.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%

Value	Count	Frequency (%)
5715	1	< 0.1%
5696	1	< 0.1%
5686	1	< 0.1%
5680	1	< 0.1%
5659	1	< 0.1%
5655	1	< 0.1%
5649	1	< 0.1%
5638	1	< 0.1%
5637	1	< 0.1%
5627	1	< 0.1%

customer_id
Real number (ℝ_≥0)

UNIQUE

Distinct	2969
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	15270.77299

Minimum	12347
Maximum	18287
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	12347
5-th percentile	12619.4
Q1	13799
median	15221
Q3	16768
95-th percentile	17964.6
Maximum	18287
Range	5940
Interquartile range (IQR)	2969

Descriptive statistics

Standard deviation	1718.990292
Coefficient of variation (CV)	0.1125673398
Kurtosis	-1.206094692
Mean	15270.77299
Median Absolute Deviation (MAD)	1488
Skewness	0.03160785866
Sum	45338925
Variance	2954927.624
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
17850	1	< 0.1%
17588	1	< 0.1%
14905	1	< 0.1%
16103	1	< 0.1%
14626	1	< 0.1%
14868	1	< 0.1%
18246	1	< 0.1%
17115	1	< 0.1%
16611	1	< 0.1%
15912	1	< 0.1%
Other values (2959)	2959	99.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
12347	1	< 0.1%
12348	1	< 0.1%
12352	1	< 0.1%
12356	1	< 0.1%
12358	1	< 0.1%
12359	1	< 0.1%
12360	1	< 0.1%
12362	1	< 0.1%
12364	1	< 0.1%
12370	1	< 0.1%

Value	Count	Frequency (%)
18287	1	< 0.1%
18283	1	< 0.1%
18282	1	< 0.1%
18277	1	< 0.1%
18276	1	< 0.1%
18274	1	< 0.1%
18273	1	< 0.1%
18272	1	< 0.1%
18270	1	< 0.1%
18269	1	< 0.1%

gross_revenue
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	2954
Distinct (%)	99.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2749.321711

Minimum	6.2
Maximum	279138.02
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	6.2
5-th percentile	229.77
Q1	570.96
median	1086.92
Q3	2308.06
95-th percentile	7219.68
Maximum	279138.02
Range	279131.82
Interquartile range (IQR)	1737.1

Descriptive statistics

Standard deviation	10580.62331
Coefficient of variation (CV)	3.848448607
Kurtosis	353.944724
Mean	2749.321711
Median Absolute Deviation (MAD)	672.16
Skewness	16.77755612
Sum	8162736.16
Variance	111949589.6
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
178.96	2	0.1%
533.33	2	0.1%
889.93	2	0.1%
2053.02	2	0.1%
745.06	2	0.1%
379.65	2	0.1%
2092.32	2	0.1%
731.9	2	0.1%
1353.74	2	0.1%
331	2	0.1%
Other values (2944)	2949	99.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
6.2	1	< 0.1%
13.3	1	< 0.1%
15	1	< 0.1%
36.56	1	< 0.1%
45	1	< 0.1%
52	1	< 0.1%
52.2	1	< 0.1%
52.2	1	< 0.1%
62.43	1	< 0.1%
68.84	1	< 0.1%

Value	Count	Frequency (%)
279138.02	1	< 0.1%
259657.3	1	< 0.1%
194550.79	1	< 0.1%
168472.5	1	< 0.1%
140450.72	1	< 0.1%
124564.53	1	< 0.1%
117379.63	1	< 0.1%
91062.38	1	< 0.1%
72882.09	1	< 0.1%
66653.56	1	< 0.1%

recency_days
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	272
Distinct (%)	9.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	64.28763894

Minimum	0
Maximum	373
Zeros	34
Zeros (%)	1.1%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	0
5-th percentile	2
Q1	11
median	31
Q3	81
95-th percentile	242
Maximum	373
Range	373
Interquartile range (IQR)	70

Descriptive statistics

Standard deviation	77.75677911
Coefficient of variation (CV)	1.209513686
Kurtosis	2.777962659
Mean	64.28763894
Median Absolute Deviation (MAD)	26
Skewness	1.798379538
Sum	190870
Variance	6046.116697
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	99	3.3%
4	87	2.9%
2	85	2.9%
3	85	2.9%
8	76	2.6%
10	67	2.3%
9	66	2.2%
7	66	2.2%
17	64	2.2%
16	55	1.9%
Other values (262)	2219	74.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	34	1.1%
1	99	3.3%
2	85	2.9%
3	85	2.9%
4	87	2.9%
5	43	1.4%
7	66	2.2%
8	76	2.6%
9	66	2.2%
10	67	2.3%

Value	Count	Frequency (%)
373	2	0.1%
372	4	0.1%
371	1	< 0.1%
368	1	< 0.1%
366	4	0.1%
365	2	0.1%
364	1	< 0.1%
360	1	< 0.1%
359	1	< 0.1%
358	4	0.1%

invoice_no
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	56
Distinct (%)	1.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5.723139104

Minimum	1
Maximum	206
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	4
Q3	6
95-th percentile	17
Maximum	206
Range	205
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	8.85653132
Coefficient of variation (CV)	1.547495379
Kurtosis	190.8344494
Mean	5.723139104
Median Absolute Deviation (MAD)	2
Skewness	10.76680458
Sum	16992
Variance	78.43814702
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2	785	26.4%
3	499	16.8%
4	393	13.2%
5	237	8.0%
1	190	6.4%
6	173	5.8%
7	138	4.6%
8	98	3.3%
9	69	2.3%
10	55	1.9%
Other values (46)	332	11.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	190	6.4%
2	785	26.4%
3	499	16.8%
4	393	13.2%
5	237	8.0%
6	173	5.8%
7	138	4.6%
8	98	3.3%
9	69	2.3%
10	55	1.9%

Value	Count	Frequency (%)
206	1	< 0.1%
199	1	< 0.1%
124	1	< 0.1%
97	1	< 0.1%
91	2	0.1%
86	1	< 0.1%
72	1	< 0.1%
62	2	0.1%
60	1	< 0.1%
57	1	< 0.1%

avg_quantity
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED

Distinct	2732
Distinct (%)	92.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	30.25312811

Minimum	1
Maximum	26999
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	1
5-th percentile	2.6
Q1	6.515151515
median	10.32061069
Q3	14.96875
95-th percentile	48.67160105
Maximum	26999
Range	26998
Interquartile range (IQR)	8.453598485

Descriptive statistics

Standard deviation	505.698578
Coefficient of variation (CV)	16.71557983
Kurtosis	2729.149047
Mean	30.25312811
Median Absolute Deviation (MAD)	4.150632762
Skewness	51.34460134
Sum	89821.53735
Variance	255731.0518
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
10	10	0.3%
9.333333333	8	0.3%
18	7	0.2%
11	6	0.2%
12	6	0.2%
9	5	0.2%
10.85714286	5	0.2%
8	5	0.2%
12.5	5	0.2%
6.5	5	0.2%
Other values (2722)	2907	97.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	3	0.1%
1.052631579	1	< 0.1%
1.055555556	1	< 0.1%
1.131578947	1	< 0.1%
1.21875	1	< 0.1%
1.223529412	1	< 0.1%
1.257142857	1	< 0.1%
1.260416667	1	< 0.1%
1.28	1	< 0.1%
1.376146789	1	< 0.1%

Value	Count	Frequency (%)
26999	1	< 0.1%
3906	1	< 0.1%
2000	1	< 0.1%
1802.8	1	< 0.1%
1756.5	1	< 0.1%
1009.5	1	< 0.1%
740	1	< 0.1%
715.2	1	< 0.1%
664.6153846	1	< 0.1%
657	1	< 0.1%

total_quantity
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	1671
Distinct (%)	56.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1608.852476

Minimum	1
Maximum	196844
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	1
5-th percentile	102.4
Q1	296
median	641
Q3	1401
95-th percentile	4407.4
Maximum	196844
Range	196843
Interquartile range (IQR)	1105

Descriptive statistics

Standard deviation	5887.578045
Coefficient of variation (CV)	3.659489067
Kurtosis	465.998084
Mean	1608.852476
Median Absolute Deviation (MAD)	422
Skewness	17.85859125
Sum	4776683
Variance	34663575.24
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
310	11	0.4%
150	9	0.3%
88	9	0.3%
246	8	0.3%
272	8	0.3%
84	8	0.3%
260	8	0.3%
288	8	0.3%
1200	7	0.2%
516	7	0.2%
Other values (1661)	2886	97.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	1	< 0.1%
2	2	0.1%
12	2	0.1%
16	1	< 0.1%
17	1	< 0.1%
18	1	< 0.1%
19	1	< 0.1%
20	1	< 0.1%
23	1	< 0.1%
25	1	< 0.1%

Value	Count	Frequency (%)
196844	1	< 0.1%
80997	1	< 0.1%
80263	1	< 0.1%
77373	1	< 0.1%
69993	1	< 0.1%
64549	1	< 0.1%
64124	1	< 0.1%
63312	1	< 0.1%
58343	1	< 0.1%
57885	1	< 0.1%

avg_ticket
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED

Distinct	2966
Distinct (%)	99.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	51.89776151

Minimum	2.150588235
Maximum	56157.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	2.150588235
5-th percentile	4.916661099
Q1	13.11933333
median	17.95658654
Q3	24.98828571
95-th percentile	90.497
Maximum	56157.5
Range	56155.34941
Interquartile range (IQR)	11.86895238

Descriptive statistics

Standard deviation	1036.934407
Coefficient of variation (CV)	19.98033011
Kurtosis	2890.707126
Mean	51.89776151
Median Absolute Deviation (MAD)	5.984842033
Skewness	53.44422362
Sum	154084.4539
Variance	1075232.964
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
15	2	0.1%
4.162	2	0.1%
14.47833333	2	0.1%
18.15222222	1	< 0.1%
13.92736842	1	< 0.1%
36.24411765	1	< 0.1%
29.78416667	1	< 0.1%
22.8792623	1	< 0.1%
20.51104167	1	< 0.1%
149.025	1	< 0.1%
Other values (2956)	2956	99.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2.150588235	1	< 0.1%
2.4325	1	< 0.1%
2.462371134	1	< 0.1%
2.511241379	1	< 0.1%
2.515333333	1	< 0.1%
2.65	1	< 0.1%
2.656931818	1	< 0.1%
2.707598253	1	< 0.1%
2.760621572	1	< 0.1%
2.770464191	1	< 0.1%

Value	Count	Frequency (%)
56157.5	1	< 0.1%
4453.43	1	< 0.1%
3202.92	1	< 0.1%
1687.2	1	< 0.1%
952.9875	1	< 0.1%
872.13	1	< 0.1%
841.0214493	1	< 0.1%
651.1683333	1	< 0.1%
640	1	< 0.1%
624.4	1	< 0.1%

avg_recency_days
Unsupported

REJECTED
UNSUPPORTED

Missing	0
Missing (%)	0.0%
Memory size	23.3 KiB

frequency
Real number (ℝ_≥0)

Distinct	1350
Distinct (%)	45.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.06327807795

Minimum	0.005449591281
Maximum	3
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	0.005449591281
5-th percentile	0.009433962264
Q1	0.01777777778
median	0.02941176471
Q3	0.05540166205
95-th percentile	0.2222222222
Maximum	3
Range	2.994550409
Interquartile range (IQR)	0.03762388427

Descriptive statistics

Standard deviation	0.1344820641
Coefficient of variation (CV)	2.125255198
Kurtosis	121.5575473
Mean	0.06327807795
Median Absolute Deviation (MAD)	0.01433823529
Skewness	8.773259386
Sum	187.8726134
Variance	0.01808542557
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.1666666667	21	0.7%
0.3333333333	21	0.7%
0.02777777778	20	0.7%
0.09090909091	19	0.6%
0.0625	17	0.6%
0.1333333333	16	0.5%
0.4	16	0.5%
0.25	15	0.5%
0.02380952381	15	0.5%
0.03571428571	15	0.5%
Other values (1340)	2794	94.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.005449591281	1	< 0.1%
0.005464480874	1	< 0.1%
0.005494505495	1	< 0.1%
0.005509641873	1	< 0.1%
0.005586592179	2	0.1%
0.005602240896	1	< 0.1%
0.005617977528	2	0.1%
0.00566572238	1	< 0.1%
0.005681818182	2	0.1%
0.005698005698	3	0.1%

Value	Count	Frequency (%)
3	1	< 0.1%
2	1	< 0.1%
1.571428571	1	< 0.1%
1.5	3	0.1%
1	14	0.5%
0.8333333333	1	< 0.1%
0.75	1	< 0.1%
0.6666666667	12	0.4%
0.6514745308	1	< 0.1%
0.6	1	< 0.1%

qty_returns
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	214
Distinct (%)	7.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	62.1569552

Minimum	0
Maximum	80995
Zeros	1481
Zeros (%)	49.9%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	1
Q3	9
95-th percentile	100.6
Maximum	80995
Range	80995
Interquartile range (IQR)	9

Descriptive statistics

Standard deviation	1512.496135
Coefficient of variation (CV)	24.33349783
Kurtosis	2765.52864
Mean	62.1569552
Median Absolute Deviation (MAD)	1
Skewness	51.79774426
Sum	184544
Variance	2287644.557
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1481	49.9%
1	164	5.5%
2	148	5.0%
3	105	3.5%
4	89	3.0%
6	78	2.6%
5	61	2.1%
12	51	1.7%
8	43	1.4%
7	43	1.4%
Other values (204)	706	23.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1481	49.9%
1	164	5.5%
2	148	5.0%
3	105	3.5%
4	89	3.0%
5	61	2.1%
6	78	2.6%
7	43	1.4%
8	43	1.4%
9	41	1.4%

Value	Count	Frequency (%)
80995	1	< 0.1%
9014	1	< 0.1%
8004	1	< 0.1%
4427	1	< 0.1%
3768	1	< 0.1%
3332	1	< 0.1%
2878	1	< 0.1%
2022	1	< 0.1%
2012	1	< 0.1%
1776	1	< 0.1%

avg_basket_size
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED

Distinct	1979
Distinct (%)	66.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	249.8137641

Minimum	1
Maximum	40498.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	1
5-th percentile	44
Q1	103.25
median	172.3333333
Q3	281.6923077
95-th percentile	600
Maximum	40498.5
Range	40497.5
Interquartile range (IQR)	178.4423077

Descriptive statistics

Standard deviation	791.5551894
Coefficient of variation (CV)	3.168581172
Kurtosis	2255.538236
Mean	249.8137641
Median Absolute Deviation (MAD)	83.08333333
Skewness	44.67271661
Sum	741697.0657
Variance	626559.6179
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
100	11	0.4%
114	10	0.3%
73	9	0.3%
82	9	0.3%
86	9	0.3%
60	8	0.3%
88	8	0.3%
75	8	0.3%
136	8	0.3%
208	7	0.2%
Other values (1969)	2882	97.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	2	0.1%
2	1	< 0.1%
3.333333333	1	< 0.1%
5.333333333	1	< 0.1%
5.666666667	1	< 0.1%
6.142857143	1	< 0.1%
7.5	1	< 0.1%
9	1	< 0.1%
9.5	1	< 0.1%
11	1	< 0.1%

Value	Count	Frequency (%)
40498.5	1	< 0.1%
6009.333333	1	< 0.1%
4282	1	< 0.1%
3906	1	< 0.1%
3868.65	1	< 0.1%
2880	1	< 0.1%
2801	1	< 0.1%
2733.944444	1	< 0.1%
2518.769231	1	< 0.1%
2160.333333	1	< 0.1%

avg_un_basket_size
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	1005
Distinct (%)	33.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	22.1547082

Minimum	1
Maximum	299.7058824
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	23.3 KiB

Quantile statistics

Minimum	1
5-th percentile	3.345454545
Q1	10
median	17.2
Q3	27.75
95-th percentile	56.94
Maximum	299.7058824
Range	298.7058824
Interquartile range (IQR)	17.75

Descriptive statistics

Standard deviation	19.51232207
Coefficient of variation (CV)	0.8807302672
Kurtosis	27.70329723
Mean	22.1547082
Median Absolute Deviation (MAD)	8.2
Skewness	3.499455899
Sum	65777.32865
Variance	380.7307127
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
13	53	1.8%
14	39	1.3%
11	38	1.3%
20	33	1.1%
9	33	1.1%
1	32	1.1%
17	31	1.0%
18	30	1.0%
10	30	1.0%
5	29	1.0%
Other values (995)	2621	88.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	32	1.1%
1.2	1	< 0.1%
1.25	1	< 0.1%
1.333333333	2	0.1%
1.5	8	0.3%
1.568181818	1	< 0.1%
1.571428571	1	< 0.1%
1.666666667	4	0.1%
1.833333333	1	< 0.1%
2	24	0.8%

Value	Count	Frequency (%)
299.7058824	1	< 0.1%
259	1	< 0.1%
203.5	1	< 0.1%
148	1	< 0.1%
145	1	< 0.1%
136.125	1	< 0.1%
135.5	1	< 0.1%
127	1	< 0.1%
122	1	< 0.1%
118	1	< 0.1%

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	df_index	customer_id	gross_revenue	recency_days	invoice_no	avg_quantity	total_quantity	avg_ticket	avg_recency_days	frequency	qty_returns	avg_basket_size	avg_un_basket_size
0	0	17850	5391.21	372.0	34.0	5.835017	1733.0	18.152222	35 days 12:00:00	0.486111	40.0	50.970588	8.735294
1	1	13047	3232.59	56.0	9.0	8.128655	1390.0	18.904035	27 days 06:00:00	0.048780	35.0	154.444444	19.000000
2	2	12583	6705.38	2.0	15.0	21.672414	5028.0	28.902500	23 days 04:30:00	0.045699	50.0	335.200000	15.466667
3	3	13748	948.25	95.0	5.0	15.678571	439.0	33.866071	92 days 16:00:00	0.017921	0.0	87.800000	5.600000
4	4	15100	876.00	333.0	3.0	26.666667	80.0	292.000000	8 days 14:24:00	0.136364	22.0	26.666667	1.000000
5	5	15291	4623.30	25.0	14.0	20.607843	2102.0	45.326471	23 days 04:48:00	0.054441	29.0	150.142857	7.285714
6	6	14688	5630.87	7.0	21.0	11.073394	3621.0	17.219786	18 days 07:12:00	0.073569	399.0	172.428571	15.571429
7	7	17809	5411.91	16.0	12.0	33.721311	2057.0	88.719836	35 days 16:48:00	0.039106	41.0	171.416667	5.083333
8	8	15311	60767.90	0.0	91.0	16.054645	38194.0	25.543464	4 days 03:28:00	0.315508	474.0	419.714286	26.142857
9	9	16098	2005.63	87.0	7.0	9.149254	613.0	29.934776	47 days 16:00:00	0.024390	0.0	87.571429	9.571429

Last rows

	df_index	customer_id	gross_revenue	recency_days	invoice_no	avg_quantity	total_quantity	avg_ticket	avg_recency_days	frequency	qty_returns	avg_basket_size	avg_un_basket_size
2959	5627	17727	1060.25	15.0	1.0	9.772727	645.0	16.064394	6 days 00:00:00	0.285714	6.0	645.000000	66.0
2960	5637	17232	421.52	2.0	2.0	5.638889	203.0	11.708889	12 days 00:00:00	0.153846	0.0	101.500000	18.0
2961	5638	17468	137.00	10.0	2.0	23.200000	116.0	27.400000	4 days 00:00:00	0.400000	0.0	58.000000	2.5
2962	5649	13596	697.04	5.0	2.0	2.445783	406.0	4.199036	7 days 00:00:00	0.250000	0.0	203.000000	83.0
2963	5655	14893	1237.85	9.0	2.0	10.945205	799.0	16.956849	2 days 00:00:00	0.666667	0.0	399.500000	36.5
2964	5659	12479	473.20	11.0	1.0	12.733333	382.0	15.773333	4 days 00:00:00	0.333333	34.0	382.000000	30.0
2965	5680	14126	706.13	7.0	3.0	33.866667	508.0	47.075333	3 days 00:00:00	1.000000	50.0	169.333333	5.0
2966	5686	13521	1092.39	1.0	3.0	1.685057	733.0	2.511241	4 days 12:00:00	0.300000	0.0	244.333333	145.0
2967	5696	15060	301.84	8.0	4.0	2.183333	262.0	2.515333	1 days 00:00:00	2.000000	0.0	65.500000	30.0
2968	5715	12558	269.96	7.0	1.0	17.818182	196.0	24.541818	6 days 00:00:00	0.285714	196.0	196.000000	11.0

Overview

Variables

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows